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1.  INTRODUCTION 

For  a  given  n-player  normal  form  game  G,  let  G(8,T)  be  the  T-fold  repeated  game 
where  the  objective  function  is  the  average  discounted  sum  of  stage  payoffs.  For  this 
finitely-repeated  game,  the  perfect  folk  theorem  is  said  to  hold  if  the  set  of  subgame  perfect 
equilibrium  (SPE)  payoffs  includes  any  feasible  and  strictly  individually  rational  payoff 
vector  of  G  for  large  enough  T  <  oo  and  8  <  1.  Benoit  and  Krishna  (1985)  [hereafter,  BK] 
produced  a  perfect  folk  theorem  for  G(6,  T)  that  obtains  when  (?)  G  satisfies  the  sufficient 
conditions  for  the  infinite-horizon  folk  theorem  —  namely,  the  full-dimensionality  condition 
of  Fudenberg  and  Maskin  (1986),  and  (ii)  each  player  has  distinct  Nash  payoffs  in  G. 

Recently,  Abreu,  Dutta  and  Smith  (1993)  discovered  an  (essentially)  iff  condition  for  (i) 
—  non-equivalent  utilities  (NEU)  —  that  neatly  supplants  full-dimensionality.  Wen  (1993) 
subsequently  examined  games  possibly  violating  NEU,  and  proved  a  revised  general  'folk 
theorem'.  Here  I  provide  a  simple,  easily  verifiable,  and  necessary  and  sufficient  condition 
for  the  finite-horizon  folk  theorem  that  replaces  (ii):  The  intuitive  condition,  recursively 
distinct  Nash  payoffs,  only  insists  that  players'  behavior  be  iteratively  leveraged  near  the 
end  of  the  repeated  game. 

The  primary  contribution  of  this  note  is  purely  conceptual:  I  wish  to  finish  the  work 
of  BK,1  and  thus  complete  the  perfect  information  folk  theorem  program.  Indeed,  just  as 
NEU  only  differed  from  full-dimensionality  by  a  nongeneric  class  of  games,  so  too,  within 
the  class  of  stage  games  with  recursively  distinct  Nash  payoffs,  the  measure  without  distinct 
Nash  payoffs  for  all  players  is  zero.  But  conceptual  clarity  is  not  without  its  own  reward,  as 
I  later  provide  a  necessary  and  sufficient  condition  for  the  finite-horizon  Nash  folk  theorem. 
I  also  recast  BK  in  Wen's  more  encompassing  framework.2  In  so  doing,  I  happen  upon  a 
simple  new  proof  of  the  necessity  of  NEU  in  Abreu  et  al.  (1993),  and  of  what  'necessity' 
means  in  Wen's  tiered  'folk'  theorems  more  generally. 

The  logic  of  the  BK  folk  theorem,  as  best  exemplified  in  Krishna  (1989)  or  Smith 
(1990/92)  is  rather  simple:  Late  in  the  repeated  game,  because  all  players  have  distinct 
Nash  payoffs,  the  behavior  of  any  one  of  them  can  be  leveraged  by  threatening  to  finish  off 
with  a  fixed  number  (say  S)  of  plays  of  that  player's  worst  Nash  payoff,  rather  than  cycle 
through  all  his  best  Nash  payoffs.  Away  from  the  end  of  the  game,  the  infinite-horizon  pun- 
ishments work  perfectly  well.  And  because  S  is  fixed  independent  of  the  horizon  length,  the 
effect  on  the  average  payoff  can  be  made  arbitrarily  small.  This  essentially  is  their  proof. 

Rather  than  formally  define  my  condition,  I  first  motivate  it  with  the  following  three- 
player  example  game  G. 


*It  should  be  noted  that  BK  conjecture  under  weak  conditions  that  only  one  player  need  have  distinct 
payoffs.  This  paper  might  in  part  be  seen  as  proving  a  precise  and  rigorous  statement  of  this  conjecture. 
2I  am  grateful  to  a  referee  for  pressing  me  on  this  point. 
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In  this  game,  1  chooses  rows  (actions  [/,  M,D),  2  chooses  columns  (actions  £,  m,  r),  and  3 
chooses  matrices  (actions  L,R).  Player  3  strictly  prefers  L  to  R,  while  action  D  (resp.  r) 
is  weakly  dominated  for  player  1  (resp.  player  2).  Thus  it  is  easy  to  see  that  the  only  Nash 
(pure  or  mixed)  payoffs  are  all  convex  combinations  of  (2, 2, 2)  and  (2, 2, 3).  Furthermore, 
the  minimax  payoff  is  0  for  all  three  players.3 

Because  players  1  and  2  have  unique  Nash  payoffs,  G  does  not  satisfy  the  BK  condition 
(ii).  Nonetheless,  a  folk  theorem  does  obtain!  For  G  satisfies  NEU,  and  thus  the  standard 
infinite-horizon  folk  theorem  applies  to  G.  Next,  player  3  enjoys  the  distinct  (extremal) 
Nash  payoffs  of  2  and  3,  so  that  his  behavior  is  leveraged  near  the  end  of  the  game:  I  need 
only  threaten  to  switch  from  (U,  £,  L)  to  (M,  £,  L)  for  the  5-period  phase.  By  choosing  S 
large  enough,  3  is  willing  to  play  R  for  as  many  periods,  say  5',  as  I  wish  just  prior  to  this 
Nash  phase.  When  player  3  plays  R  irrespective  of  what  players  1  and  2  do,  a  new  game 
G(R)  is  induced  for  players  1  and  2.  It  has  the  unique  Nash  equilibrium  payoff  vector 
(2, 1).  So  player  2's  Nash  payoff  from  G(R)  is  1,  which  differs  from  his  unique  Nash  payoff 
in  G(R)  (i.e.  when  player  3  plays  L).  I  have  now  leveraged  the  behavior  of  player  2  near 
the  end  of  the  game!  Iterate  this  process.  By  choosing  S'  (and  by  implication  S)  large 
enough,  I  can  induce  player  2  to  play  £ ,  m,  or  r  for  as  many  periods,  say  5",  as  I  wish 
just  prior  to  this  penultimate  'Nash'  phase.  In  particular,  players  2  and  3  are  willing  to 
play  (r,  R)  irrespective  of  what  player  1  does,  yielding  a  new  (one-player)  game  G(r,  R) 
for  player  1.  It  has  the  unique  optimal  payoff  of  0,  which  differs  from  l's  unique  optimal 
payoff  of  2  in  G(£,  L).  I  have  now  also  leveraged  the  behavior  of  player  1  near  the  end  of 
the  game!  That  G  satisfies  a  folk  theorem  now  follows  by  the  same  proof  as  before. 

I  summarize  the  above  procedure  by  saying  that  G  has  recursively  distinct  Nash  payoffs. 
If  a  game  G  satisfies  NEU,  it  is  sufficient  for  the  BK  result:  So  long  as  such  a  recursive 
procedure  eventually  leverages  the  behavior  of  all  players,  then  a  perfect  folk  theorem 
obtains.  And  my  new  condition  is  necessary  too  for  the  general  perfect  finite-horizon  'folk 
theorem'.  Namely,  if  for  any  such  chain  of  recursive  reductions,  I  cannot  leverage  the 
behavior  of  all  players,  then  a  'folk  theorem'  does  not  obtain. 

The  intuition  behind  the  necessity  is  also  rather  simple.  For  any  given  horizon  length  T, 
a  player's  set  of  SPE  payoffs  is  either  point-valued,  or  it  is  not.  Evidently,  if  the  behavior  of 
a  player  can  be  leveraged  as  above,  then  his  SPE  payoffs  are  multivalued  for  large  enough 
T,  while  if  his  behavior  cannot  be  leveraged,  then  he  entertains  a  unique  equilibrium 


3  But  observe  that  no  one  player  can  simultaneously  minimax  the  other  two,  a  fact  of  some  importance 
later  on  in  my  remarks  on  the  necessity  of  NEU. 


payoff  for  all  T.  Clearly,  in  the  latter  case,  I  cannot  possibly  hope  for  anything  more.  For 
instance,  in  G  with  no  discounting,  player  3  has  a  multivalued  SPE  payoff  set  for  all  T, 
while  players  2  and  1  only  receive  distinct  SPE  payoffs  for  T  >  5  and  T  >  19,  respectively. 

The  special  payoffs  in  G  speak  to  the  genericity  of  the  distinct  Nash  payoff  requirement 
when  the  folk  theorem  obtains.  Indeed,  if  one  player  has  distinct  Nash  payoffs,  then  the 
game  has  at  least  two  pure  and  generically  a  third  mixed  Nash  equilibrium.  Thus,  for 
generic  games  satisfying  my  condition,  all  players  enjoy  distinct  Nash  payoffs. 

Section  2  focuses  on  the  stage  game,  and  describes  my  iterative  procedure.  I  dwell  on 
sufficiency  (the  folk  theorem)  in  section  3.1,  and  necessity  (in  all  respects)  in  section  3.2. 

2.  THE  STAGE  GAME 

2.1  Basic  Definitions 

Let  G  =  (Ai,  7r,-;  i  =  1, . . . ,  n)  be  a  finite  normal  form  n-player  game,  where  Ai  is  player 
i's  finite  set  of  actions,  and  A  =  xt"=1J4,-.  Let  player  i's  utility  function  be  ir, ,  :  A  — )-  M,  and 
set  7r(a)  =  (tti(o),  . . . ,  nn(a)).  Let  Mi  be  player  i's  mixed  strategy  set,  with  M  =  x"=1M,-. 
Simply  write  7r,(^)  for  Vs  expected  payoff  under  the  mixed  strategy  fi  =  (/ii, . . .  //„)  €  M. 

The  game  G  has  non-equivalent  utilities  (NEU)  if  no  two  players'  von  Neumann  Mor- 
genstern  utility  functions  are  equivalent,  i.e.  for  all  i  and  j,  7r,(-)  is  not  a  positive  affine 
transformation  of  nj(-).  Denote  the  set  of  players  as  1  =  {1,2, ...  ,n}.  Following  Wen 
(1993),  let  {lb  C  X,  b  =  1, . . . ,  B}  be  the  coarsest  partition  of  I  such  that  any  two  players 
in  the  same  X&  have  equivalent  utilities;  denote  by  X{i)  all  players  with  equivalent  utilities 
to  i.  Normalize  payoffs  so  that  7r,-(-)  =  ttj(-)  for  all  j  €  1{i).  The  effective  minimax  payoff 
level  7r,(w')  =  mina  maXj6i(,)  max„  7r,(aj,  a_j)  of  player  i  is  the  best  payoff  that  anyone  in 
X(i)  can  guarantee  himself,  i.e.  the  greatest  minimax  payoff  over  all  players  in  I(i)-4 

Normalize  n^w')  =  0  for  all  i.  Define  F  =  co{7r(//)  :  /j,  e  M},  and  call  F*  =  {w  G  F  : 
Wi  >  0,  for  all  i}  the  feasible  and  (strictly)  rational  payoff  set.  To  sidestep  trivialities,  let 
F*  ^  0.  Note  that  under  NEU,  wl  reduces  to  the  standard  minimax  strategy  for  player  z, 
and  F*  the  feasible  and  (strictly)  individually  rational  payoff  set. 


4Wen  (1993)  does  not  describe  it  as  such,  but  it  is  true.  Indeed,  w'  is  certainly  a  minimax  profile 
for  some  player  j  €  1(i).  To  see  that  iri(wl)  weakly  exceeds  any  minimax  payoff  for  all  j  £  Z{i),  let 
Kj(a)  =  maxa<  nj(a'j,a.-j)  for  j  €  I.  Analogous  to  the  fact  that  the  minimax  >  maximin  in  constant  sum 
games, 

Tr^u;')  =  minmax7Tj(a)  >  maxmin  Jrj(a)  =  max  [  minmax7r,(a,-,a_,)  )  . 

a      j€I  j€/      a  j€/    \a-j      ai  J 


2.2  Recursively  Distinct  Nash  Payoffs 

Given  a  subset  of  players5  J'  =  {ji,  j%, . . . ,  jm}  C  X  and  their  (possibly  mixed)  actions 

a j,  =  (ah ,ah,..., ajm )  €  Mh  x  Mh  x  •  •  •  x  Mjm  =  Mj>,  (1) 

let  G(aj>)  be  the  induced  (n  —  m)-player  game  for  players  X\J'  obtained  from  G  when 
the  actions  of  players  J'  are  fixed  to  aj> . 

Define  a  Nash  decomposition  of  G  as  an  increasing  sequence  of  h  >  1  nonempty  subsets 
of  players  from  I,  namely 

{0  =  JoC  JiC  J2C---C  JhQX},  (2) 

so  that  for  g  =  1, . . . ,  h,  actions  ejg_x ,  fjg_y  G  Mjg_Y  exist  with  a  pair  of  Nash  payoff  vectors 
y{eJg-i)  of  G(e^_,)  and  y{fjg_x)  of  G{fJg_1)  different  exacta/  for  players  in  Jg  \  Jg_u  i.e. 

Viej^i  *  V(fs^)i  (3) 

for  all  i  E  Jg\  Jg-\-  For  instance,  players  in  J\  have  distinct  Nash  payoffs  in  G. 

The  game  G  has  recursively  distinct  Nash  payoffs  if  there  is  a  Nash  decomposition  with 
Jh  =  X.  So  if,  as  in  BK,  all  players  have  distinct  Nash  payoffs  in  G,  then  this  condition 
holds.  The  converse  is  not  true,  as  illustrated  earlier.  I  later  consider  games  G  that  do 
not  have  recursively  distinct  Nash  payoffs,  i.e.  Jh  =  X  is  impossible.  An  ambiguity  may 
then  arise,  since  Nash  decompositions  need  not  be  unique.  It  is  not  inconceivable  that  the 
union  of  all  Nash  decompositions  could  include  every  player.  In  fact,  this  cannot  occur.6 

Lemma     There  is  a  well-defined  maximal  set  of  players  J*  C  X  who  have  recursively 
distinct  Nash  payoffs. 

3.  FINITELY-REPEATED  GAMES 

3.1   Sufficiency  of  Recursively  Distinct  Nash  Payoffs 

I  shall  analyze  finitely-repeated  games  with  perfect  monitoring,  allowing  each  player  to 
condition  his  current  actions  on  the  past  actions  of  all  players. 

Let  a,  =  (a,i , . . . ,  oj.t)  be  a  behavior  strategy  for  player  i,  and  nu  (a)  his  expected  payoff 
in  period  t  with  the  strategy  profile  a.  Player  i's  objective  function  in  G(S,  T)  is  the  ex- 
pected discounted  sum  of  his  payoffs:  -—^  Y.J  <5(-17r,((a).  The  set  of  SPE  payoffs  is  V(6,  T). 


5Throughout,  A  C  B  means  that  A  is  a  strict  subset  of  B,  i.e.  AC  B  and  A  /  B. 
6The  proof  of  this  result  is  omitted;  see  my  (1994)  working  paper. 


Beyond  replacing  the  distinct  Nash  payoff  requirement,  Theorem  1  differs  from  BK's 
Theorem  3.7  in  three  ways.  First,  it  admits  payoff  discounting,  where  5  and  T  can  vary 
independently  over  the  relevant  range.  Second,  it  is  a  more  general  'folk  theorem',  as 
pursued  by  Wen  (1993),  which  will  imply  BK's  result  with  NEU.  Third,  unlike  the  (more 
intuitive)  use  of  long  deterministic  cycles  in  BK,  public  randomization  is  used:  In  every 
period,  players  can  condition  on  the  outcome  of  a  publicly  observed  exogenous  continuous 
random  variable.7  Just  as  in  BK,  I  shall  assume  that  players  can  observe  deviations  within 
the  support  of  strictly  mixed  strategies.  Alternatively,  just  assume  that  the  folk  theorem 
refers  to  the  pure  strategy  minimax  payoff  level.8 

Theorem  1  (The  'Folk  Theorem')  Suppose  that  the  stage  game  G  has  recursively  dis- 
tinct Nash  payoffs.  Then  for  the  finitely-repeated  game  G(5,T),  V«  €  F*  and  Ve  >  0, 
3  T0  <  oo  and  S0  <  1  so  that  T>T0  and  S  G  [50, 1]  =►  3v  G  V(S,  T)  with  \\v  -  u\\  <  e. 

Proof:     Fix  a  Nash  decomposition  (2)  for  which  inequality  (3)  obtains,  and  define 

c9  =  .*W£     \\y(eJ.-i)i  ~  y(fjg-i)i\\  >  ° 

*€  Jg\  J 9-1 

for  g  =  1, 2, . . . ,  h.  Let  the  p  >  0  be  the  largest  payoff  range  (i.e.  the  difference  between 
best  and  worst  payoffs)  for  any  player  in  G,  and  ipg(k)  the  least  even  number  above 
2kp/cg.  Saving  on  notation,  let  y9  denote  y{ejg_^ )  in  even  periods  and  y{fjg_, )  in  odd 
ones.  Further,  let  z9A  be  the  less  preferred  Nash  payoff  vector  amongst  y(ej  _, )  and 
y(fjg-i)  for  player  i  €  Jg\  Jg-\.  Since  for  all  i  e  Jg\  Jg-u 

-kp  +  ii>g(k)y?>i>g(k)z?>i,  (4) 

it  follows  that  without  payoff  discounting,  any  player  i  has  a  strict  incentive  to  conform 
to  k  consecutive  periods  of  any  action  profile  followed  by  ipg{k)  periods  of  y9,  if  deviations 
are  punished  by  switching  each  y9  to  z9,t. 

For  any  m  >  0,  recursively  define  Sh(m)  =  iph(m)  and 

sg(m)  =  ijjg(m  +  sg+i(m)  H 1-  sh(m)) 

for  g  =  h  —  l,h  —  2, . . . ,  1.    Define  £o(m)  =  0>  and  tg(m)  =  si(ra)  +  •••  +  sg(m)  for 


7  One  may  also  take  advantage  of  the  correlating  device  to  produce  a  nearly  exact,  rather  than  an 
approximate,  folk  theorem.  That  is,  one  can  use  the  correlation  device  to  do  away  with  the  ^approximation 
for  all  payoff  vectors  not  on  the  boundary  of  F.  I  omit  such  a  laborious  exercise. 

This  assumption  is  not  necessary  to  detect  deviations  from  the  minimax  phase  (step  3,  below),  as 
noted  in  my  (1994)  working  paper.  But  for  the  two  recursively  Nash  phases,  no  such  workaround  exists. 
It  would  thus  be  interesting  to  know  whether  Theorem  2  goes  through  when  J*  is  defined  given  pure 
actions  (1),  in  which  case  this  would  not  be  a  concern. 


g  =  1, . . . ,  h.  The  T-period  equilibrium  outcome  sequence  is 

a,...,a;yh,...,yh;...;y\...,y1 

where  a  is  played  for  T—th(q+r)  periods,9  and  y9  is  played  for  sg(q+r)  periods.  Fix  £  >  0. 
If  v  is  the  (5-discounted  average  payoff  vector,  then  \\v  —  u\\  <  e  for  big  enough  5  and  T. 

Abreu  et  al.  (1993)  have  established  the  existence  of  feasible  payoff  vectors  x1, . . .  ,xn 
such  that  for  alii  ^  j,  xx  3>  0  (strict  IR),  x\  <  x?  for  all  j  £  Z(i)  (payoff  asymmetry),  and 
x\  <  Ui  (target  payoff  domination). 

I  now  explicitly  describe  the  players'  strategies  which  support  this  equilibrium.10  For 
ease  of  exposition,  late  deviations  are  those  occurring  during  the  final  q  +  r  +  th(q  +  r) 
periods  of  the  repeated  game;  all  others  are  called  early  deviations. 

1.  Main  Path.  Play  a  until  period  T  —  th(q  +  r).  [If  any  i  deviates  early,  start  3;  if 
some  player  in  Jg<  deviates  late,  start  5.] 

2.  Good  Recursive  Nash  Phase.  For  g  =  h,...,l\  Play  y9  in  periods  T  -  tg(q  + 
r)  +  1, . . . , T  —  tg-i(q  +  r).  [If  some  i  G  Jg>  deviates  late,  where  g'  <  g,  start  5.] 

3.  Minimax  Phase.  Play  w'  for  q  periods.  [If  j  £  X(i)  deviates,  start  4.]  Set  j  4-  i. 

4.  Reward  Phase.  Play  xJ  for  r  periods.  [If  any  i  deviates  early,  restart  3;  if  some 
i  G  Jg>  deviates  late,  start  5.]  Then  return  to  step  1  or  2. 

5.  Bad  Recursive  Nash  Phase.  Play  z9'^  until  period  T  -  V-i(?  +  r)-  pfj  e  <?g" 
deviates,  where  g"  <  g' ,  set  g'  «—  g"  and  i  -f-  j  and  restart  5.]  Then  go  to  step  2. 

It  is  straightforward  (or  see  my  (1994)  working  paper)  to  verify  that  these  strategies 
constitute  an  SPE  for  some  q,  r  and  big  enough  5q  and  To.11  0 

3.2  Necessity  of  Recursively  Distinct  Nash  Payoffs 

If  a  game  G  does  not  have  recursively  distinct  Nash  payoffs,  the  consequences  are 
rather  stark.    The  following  result  has  a  flavour  of  the  "zero-one"  laws  of  probability 


9Note  that  q  and  r  are  implicitly  defined  in  steps  3  and  4  below. 

10Below,  i  and  j  denote  arbitrary  players,  and  g,  g' ,  and  g"  arbitrary  indices  in  {1, 2, . . . ,  h).  For  clarity, 
I  shall  use  the  simple  notation  j  <—  i  to  mean  "assign  j  the  value  i."  Also,  steps  always  follow  sequentially, 
unless  otherwise  indicated.  Bracketed  remarks  refer  to  off-path  play,  i.e.  following  deviations. 

11  Absent  public  randomization,  the  simple  direct  proof  presented  above  would  require  two  modifications: 
First,  the  target  outcome  a  would  have  to  be  replaced  by  an  approximating  finite  outcome  profile.  Second, 
ditto  for  each  x'  vector.  Finally,  to  my  knowledge,  public  randomization  is  essential  if  one  wishes  to  work 
with  the  mixed  minimax  strategy,  which  I  noted  earlier  was  possible.  See  for  instance,  Abreu  et  al.  (1993). 


theory.  Namely,  as  T  — >  oo,  either  V(S,T)  tends  to  the  strictly  individually  rational 
payoff  set  F*,  or  some  players  receive  a  unique  SPE  payoff.  There  is  no  middle  ground. 

Theorem  2  For  any  T  <  oo  and  any  S  £  (0, 1],  players  inX\J*  receive  a  payoff  in  any 
SPE  of  G(S,T),  equal  to  their  unique  Nash  equilibrium  payoff  of  G.12 

Proof:  Every  player  in  X  \  J*  has  a  unique  Nash  and  hence  SPE  payoff  in  G(S,  1)  =  G. 
Assume  that  everyone  in  I  \  J*  has  a  unique  SPE  payoff  in  G(8,  T)  equal  to  his  Nash 
payoff  in  G,  for  T  =  1, . . .  ,T0.  Then  in  the  first  period  of  G(S,T0  +  1),  players  in  X  \  J* 
must  play  a  Nash  equilibrium  of  G(ej.),  for  any  ej-  €  Mj.,  because  they  have  a  unique 
SPE  continuation  payoff  by  assumption.  By  induction,  the  result  obtains  for  all  T.  0 
Remarks: 

1.  This  stark  necessity  result  contrasts  markedly  with  the  partial  failure  of  NEU,  where 
we  need  only  replace  the  minimax  payoff  level  with  the  effective  minimax  payoff  level. 

2.  Let  F*  =  {v  €  F*\v{  >  mina  max j€x(t)  maxaj  7ti(ajia-j)  V«},  where  the  partition 
{lb}  strictly  refines  {Xf,}.13  If  (+)  for  no  such  partition  {lb}  does  there  exist  any  strategy 
profile  separately  holding  two  or  more  players  in  any  Xb  to  their  worst  feasible  payoff  in 
F* ,  then  necessarily  7r,(w')  >  mina  max -€ f,^  max^  7r,-(oy,o_j-),  for  X(i)  C  X(i).  But  Wen 
(1993)  proves  that  all  SPE  payoffs  Pareto  dominate  the  effective  minimax  outcome.14 
This  yields  'necessity'  in  another  respect:  The  folk  theorem  fails  when  F*  is  replaced  by 
F*.  By  corollary,  the  necessity  result  of  Abreu  et  al.  (1993)  follows!  For  under  NSM 
(a  particularization  of  (*)),  if  NEU  fails,  then  {It}  admits  a  strict  refinement,  and  the 
(standard)  finite-  or  infinite-horizon  folk  theorem  cannot  obtain! 

3.  Recursively  distinct  Nash  payoffs  is  also  the  necessary  and  sufficient  condition  for 
the  finite  horizon  Nash  folk  theorem,  due  to  Benoit  and  Krishna  (1987).15 


12Note  that  this  theorem  says  nothing  about  the  payoff  set  of  players  in  J*. 

13That  is,  0  £  l(i)  C  l(i)  for  all  i,  and  X(i)  C  I(»)  for  some  i. 

14Unlike  his  folk  theorem,  this  result  of  his  actually  doesn't  rely  on  observable  mixed  strategies.  And  it 
holds  for  finitely-repeated  games  too. 

15I  am  grateful  to  a  refereefor  suggesting  this.  For  a  proof  of  sufficiency,  consider  the  following  strategies: 
Let  the  equilibrium  path  follow  steps  1  and  2.  Off-path,  retain  the  minimax  phase,  step  3,  but  allow  it  to 
last  until  the  end  of  the  game,  and  omit  any  reference  to  play  after  deviations,  including  step  4  (as  it  is 
not  needed  in  a  Nash  equilibrium);  finally,  retain  step  5,  but  omit  the  references  to  off-path  play.  To  see 
necessity,  just  observe  that  Theorem  2  still  obtains  if  SPE  is  replaced  by  Nash  equilibrium. 
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4.  APPENDIX:  OMITTED  MATERIAL 

4.1  Proof  of  Lemma 

If  for  some  Nash  decomposition  I  have  Jh  =  X,  then  unambiguously  J*  =  2,  and  I  am 
done. 

Otherwise,  let  £,(G)  be  the  set  of  all  Nash  payoffs  for  player  i  in  the  game  G.  Consider 
the  alternative  unique  nested  sequence  of  h!  nonempty  sets  {Jg}  satisfying 

{0  =  J0  C  Ji  C  J2  C  •  •  •  C  Jh>  C  J}, 

given  by  the  following  (well-defined)  recursion:  Given  Jg,  the  set  Jg+i  \  Jg  is  all  players 
i  €  X\Jg  for  whom  {£i(G(aj  )),  aj  G  Mj  }  does  not  consist  of  a  singleton.  If  no  such 
players  Jg+\  \  Jg  exist,  set  h!  =  g. 

Note  that  it  may  not  be  possible  to  find  only  two  Nash  equilibria  providing  distinct  pay- 
offs simultaneously  for  all  players  i  G  Jg+\\Jg-  Still,  I  can  show  that  Jh  =  Jh  for  all  Nash 
decompositions  (1).  For  it  is  clear  that  Jh  C  Jh<.  Moreover,  for  any  such  nested  sequence 
(1),  all  players  in  any  Jg>  are  eventually  included  in  some  Jg.  For  if  {£i(G(a,j,)),aj,  € 
Mj,}  does  not  consist  of  a  singleton,  then  neither  does  {£i(G(aj„)),aj„  G  Mj,,}  if 
J'CJ". 

4.2  Omitted  Parts  of  Proof  of  Theorem  1 

Step  1:  Observable  Mixed  Strategies 

I  proceed  recursively  as  I  ensure  subgame  perfection.  First  note  that  J  only  check 
that  all  deterrents  are  strict  by  some  positive  margin,  say  1,  without  discounting.  Given 
continuity  of  discounted  sums  in  5,  they  will  thus  remain  strict  for  any  level  of  discounting 
S  G  [5o,l],  for  some  5q  <  1.  I  shall  check  that  after  no  history  consisting  of  isolated 
deviations  does  a  one-shot  deviation  yield  a  higher  payoff  than  the  strategy  profile;  by  the 
"unimprovability"  criterion,  that  profile  will  be  a  subgame  perfect  equilibrium. 
I  now  select  q  and  r.  In  light  of  x\  >  0,  let  q  satisfy16 

w\  +  qx)  >  PI  +  1  (4) 

for  all  i,  where  /?'  (resp.  w')  is  the  best  (resp.  worst)  payoff  vector  for  player  i  in  G.  Since 
x\  <  U{  too,  (4)  simultaneously  renders  steps  3  and  4  a  strict  deterrent  to  early  deviations 


16The  inequality  (4)  —  in  particular,  why  the  left-hand  side  is  not  (q  +  l)x\  —  reflects  the  fact  that 
obeying  the  random  correlating  device  generating  x'  might  sometimes  require  i  to  play  his  worst  possible 
outcome. 


from  step  1,  for  any  r.  Next,  step  4  deters  deviations  from  step  3  if  r  is  large  enough  that 

qw'j  +  rxj  >  Pj+  rx3]  +  (q-  1)uj  +  1 

for  all  j  7^  i.  This  is  possible  because  Xj  >  x^. 

Next,  I  verify  that  step  5  deters  all  late  deviations.  Indeed,  this  is  an  immediate 
consequence  of  inequality  (3),  which  upon  substitution  yields 

[q  +  r  +  sg+l(q  +  r)  +  ■  •  •  +  sh{q  +  r)](-p)  +  sg(q  +  r)yf 
=    i>;1(s9(Q  +  r))(-p)  +  sg(q  +  r)y? 
>    sg(q  +  r)zf'1  ■+  1 

for  all  i  G  lg,  and  g  =  1, 2, . . . ,  h. 

Given  q  and  r  as  defined  above,  the  above  program  is  feasible  if  To  >  q  +  r  +  th{q  +  r). 
For  T  >  T0,  each  deterrent  remains  strict  for  all  S  €  [<$o,l],  f°r  some  80  <  1.  Finally, 
for  T0  <  oo  and  50  <  1  large  enough,  the  resulting  average  payoff  vector  v  €  F*  satisfies 
\\u  —  v\\  <  e,  since  q  and  r  are  fixed. 

Step  2:  Unobservable  Mixed  Strategies 

The  argument  is  an  adaptation  of  Abreu  et  al.  (1993)  —  to  which  the  reader  is  referred 
for  a  simple  argument  that  I  need  only  (below)  consider  deviations  from  m'  by  those  players 
j  7^  i  for  whom  the  projection  of  F  onto  the  i-j  coordinate  plane  has  full  dimension;  for 
any  other  player  k,  play  proceeds  just  as  in  step  l.17 

There  must  exist  payoff  vectors  c'-'  6  F*  such  that:  (a)  i  is  indifferent  between  x'  and 
cIJ,  or  x\  =  c\3\  (b)  j  is  not  indifferent  between  c,J  and  x1,  or  c-  ^  xlj\  and  (c)  j  prefers 
c!J  to  xJ,  or  clj  >  arj:  After  step  4,  payoff  x'  in  step  5  is  probabilistically  replaced  by  cli 
(via  the  public  randomization  device) ,  where  the  probabilities  are  chosen  to  maintain  the 
incentives  of  minimaxing  players  j  ^  i,  and  player  i  is  unaffected  by  the  transitions  given 
(a). 

Let  Pt'(aj)  satisfy  for  all  aj,a'j  in  the  support  of  m},  and  t  <  q, 

Kj  {a, ,  raLj )  -  ttj  (a'j ,  wLj )  = 
*-h-i(1  +S  +  -..+  S^Mia'j)  -p^ajW/  -  x)).  (5) 

That  such  real  numbers  p\3{-)  exist  is  a  consequence  of  (b).  That  they  can  be  chosen  to 
be  (non-unique)  probabilities  follows  from  this  construction,  for  instance,  when  cj  >  x^  in 
(6):  Let  p\3{aj)  =  0,  where  action  a,-  yields  the  highest  myopic  payoff  to  player  j  (when  the 


17  Below,  if  such  k  exist,  the  expression  uj  ^  *"  actually  denotes  j  ^  i,  k. 
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other  players  play  m*  •).  If  action  a'j  yields  the  lowest  myopic  payoff  to  player  j,  then  after 
substituting  p\3{aj)  =  0  in  (5),  it  will  follow  that  pJJ(Oj)  <  l/(n  —  l)q  for  large  enough 
8  <  1  and  r.  Furthermore,  plt{a")  <  l/(n  —  \)q  for  any  larger  8  and  r,  or  any  other  action 
a"  in  the  support  of  m1-.  Also  observe  cj  >  x^  implies  that  ptj(a")  >  0  for  all  a'-. 

If  the  realized  sequence  of  action  profiles  is  aq  =  (a,i,a,2, . . . ,  ag),  then  c'-7  replaces  a;*  in 
step  4  with  probability  pxi{aq)  =  £?  p^  (ajt)  for  all  j  ^  i.  By  construction,  0  <  pij(-)  < 
l/(n  —  1)  for  each  j  ^  i,  yielding  a  well-defined  probabilistic  transition  function.  As  p?  is 
independent  of  actions  by  players  j  ^  i  and  of  j  's  own  actions  in  periods  s  ^t,  (5)  ensures 
that  players  are  indifferent  across  the  support  of  their  minimaxing  strategies.  Finally,  in 
light  of  (c),  the  punishments  that  previously  supported  step  5  still  obtain. 
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